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Abstract 

Simple lower and upper bounds on mean cycle time in stochas- 
tic acyclic fork-join networks are derived using the (max, -algebra 
approach. The behaviour of the bounds under various assumptions 
concerning the service times in the networks is discussed, and related 
numerical examples are presented. 
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1 Introduction 

One of the problems of interest in the analysis of stochastic queueing net- 
works is to evaluate the mean cycle time of a network. Both the mean 
cycle time and its inverse which can be regarded as a throughput, present 
performance measures commonly used to describe efficiency of the network 
operation. 

It is frequently rather difficult to evaluate the mean cycle time exactly, 
even though the network under study is quite simple. To get information 
about the performance measure in this case, one can apply computer simula- 
tion to produce reasonable estimates. Another approach is to derive bounds 
on the mean cycle time (see examples in [H El E] ) . 

The paper is concerned with the derivation of a lower and upper bounds 
on the mean cycle time for stochastic acyclic fork-join queueing networks 
[H [2]. A useful way to represent dynamics of the networks is based on 
the (max, -|-) -algebra approach O O |6]. We apply the (max, -|-) -algebra 
dynamic representation proposed in [3 18] to get algebraic bounds and then 
exploit them to derive bounds in the stochastic case. 
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Compared to the techniques proposed in [U [3], which mainly rely on 
results of the theory of large deviations as well as the Perron-Frobenius 
spectral theory, our approach is essentially based on pure algebraic manip- 
ulations combined with application of bounds on extreme values, obtained 
in PdU]. 

2 Algebraic Definitions and Results 

The (max, +) -algebra is an idempotent commutative semiring (idempotent 
semifield) which is defined as Rmax = (K, ®, iS") with R = R U {e} , e = — oo , 
and binary operations ® and (8> defined as 

X © y = max(x, y), x®y = x + y Vx,yGR. 

As it is easy to see, the operations and ® retain most of the prop- 
erties of the ordinary addition and multiplication, including associativity, 
commutativity, and distributivity of multiplication over addition. However, 
the operation © is idempotent; that is, for any a; S R, one has x® x = x. 

There are the null and identity elements, namely e and 0, to satisfy the 
conditions x(Be = e(Bx = x, and x(^Q = Q(^x = x, for any x ^ R. The 
null element e and the operation ® are related by the usual absorption rule 
involving x®e = e®x = £. 

Non-negative power of any x G R is defined as 

a;®° = 0, x®'' = X © • • • © X 

q times 

for any integer q>\. Clearly, the (max, +) -algebra power x®'^ corresponds 
to qx in ordinary notations. 

2.1 Algebra of Matrices 

The (max, +) -algebra of matrices is readily introduced in the regular way. 
Specifically, for any (n x n) -matrices X = (xij) and Y = (uij) , the entries 
of U = X ®Y and V = X (giY are calculated as 

n 

Uij — Xij (B Uij , and Vij = 2;jA; © Vkj, 

k=l 

where stands for the iterated operation ©. As the null element, the 
matrix £ with all entries equal to e is taken in the algebra, whereas the 
diagonal matrix E = diag(0, . . . , 0) with the off-diagonal entries set to e 
presents the identity. 

For any square matrix X ^ £ , one can define 

X^° = E, X®« = X©- - -©X 

q times 
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for any integer q > 1. However, idempotency in this algebra leads, in 
particular, to the matrix identity 

For any matrix X , its norm is defined as 

The matrix norm possesses the usual properties. Specifically, for any matrix 
X , it holds ll^ll^ > e, and H-'^ll^ = £ if and only if X = 6 . Furthermore, 
||c X\\^ = c C5 ll-'^ll^ for any c G R, and 

~ ll^lle ® ll^ll© ' 

\\x^Y\\^ < ||x||^®||y||^ 

for any two conforming matrices X and Y . Note that for any c > 0, we 
also have llcXlL = cIlXll . 

Consider an (nx n) -matrix X with its entries Xij G R. It can be treated 
as an adjacency matrix of an oriented graph with n vertices, provided each 
entry Xij ^ e implies the existence of the edge {i^j) in the graph, while 
Xij = e does the lack of the edge. 

It is easy to verify that for any integer > 1 , the matrix X®'^ has its the 
entry x'f^ 7^ e if and only if there exists a path from vertex i to vertex j in 
the graph, which consists of q edges. Furthermore, if the graph associated 
with the matrix X is acyclic, we have X^'^ = £ for all q > p, where p is the 
length of the longest path in the graph. Otherwise, provided that the graph 
is not acyclic, one can construct a path of any length, lying along circuits, 
and then it holds that X^i 7^ f for all g > 0. 

2.2 Further Algebraic Results 

For any graph, its adjacency matrix G with the elements equal either to 
or £ is said to be standard. It is easy to verify the next statement. 

Proposition 1. For any matrix X , it holds 

X < \\X\\^<2>G, 

where G is the standard adjacency matrix of the graph associated with X . 
In particular, for a matrix D = diag(<ii, . . . , d„) , we have 



D < \\D\\^(RiE 
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Proposition 2. Let matrices Xi, . . . ,Xk have a common associated acyclic 
graph, p be the length of the longest path in the graph, and 



where mi, . . . , mt are nonnegative integers. 

If it holds that mi + • • • + > p, then X = 8 . 



Proof. 



where m = mi + • • • + m^ ■ 

Since the associated graph is acyclic, it liolds that G®'^ = £ for all q > p. 
Therefore, if m > p, then G"^™ = £ , and we arrive at the inequality X < £ 
which leads us to the desired result. □ 

Lemma 1. Let matrices Xi,...,Xk have a common associated acyclic 
graph, and p be the length of the longest path in the graph. 

If > for all i = l,...,k, then for any nonnegative integers 

mi, . . . , mk , it holds 



X{^{E®X, 



i=l 



< 



/ k \®P 



where denotes the iterated operation . 
Proof. Consider the matrix 

k 

x = l[jEex,y 

i=l 

and represent it in the form 

X = {EQXi 

mi 



(EeXk) 



rrtfc 



mi 



mfc 



~ Z^ffi ■ ■ ■ Z^® 1 

il=0 ifc=0 



0<n 



where m = mi + • • • + . From Proposition [2] we may replace m with p 
in the last term to get 



^ < Ee 

0<iiH \-ik<P 
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Proceeding to the norm, with its additive and multiphcative properties, 
we arrive at the inequahty 

0<ji+-+jfc<p 

Since 0< H-'^jll^ < ||^i||jg©---© ll-'^fcll^ for ah z = 1, . . . , /c, we finally have 
ll^lle < i:e(ll^ille®---®ll^^lle)^^ 

3 Elements of Probability 

In this section we present some probabilistic results associated with (max, +)- 
algebra concepts introduced above. We start with a lemma which states 
properties of the expectation with respect to the operations ® and (S" • 

Lemma 2. Let ^i, ■ ■ ■ ,£,k be random variables taking their values in R, and 
such that their expected values E[^i] , i = 1, . . . , k , exist. Then it holds 

1. E[ei©---©efc] > E[ei]©---©E[^fc], 

2. E[ei © • • • © Cfc] = nil] nik] ■ 

Proof. Clearly, it will suffice to prove the lemma only for k = 2, and then 
extend the proof by induction to the case of arbitrary k . 

To verify the first inequality, first assume that one of the expectation on 
its right side, say E[^2]) is infinite; that is E[^2] = Since it holds that 
© ^2 > , we have 

E[ei©e2]>E[6] = E[6]©E[e2]. 

Suppose now that E[,^i], E[^2] > e, and consider the obvious identity 
x®y = ^{x + y+\x -y\) \/x,yeR. 
With ordinary properties of expectation, we get 

E[6 ©6] > + + \m] - m]\) = nci] © nc2]. 

The second assertion of the lemma is trivial. □ 

The next result [HI HH] provides an upper bound for the expected value 
of the maximum of independent and identically distributed (i.i.d.) random 
variables. 



5 



Lemma 3. Let £,i,---,£,k be i.i.d. random variables with IE[Ci] < oo and 
D[^i] < oo. Then it holds 



,i=l 



Consider a random matrix X with its entries Xij taking values in R. 
We denote by E[X] the matrix obtained from X by replacing each entry 
Xij by its expected value E[xij]. 

Lemma 4. For any random matrix X , it holds 

E||X||^>||E[X]||^. 
Proof. It follows from Lemma [5] that 



E 



> 



^3\ 



□ 



4 Acyclic Fork-Join Networks 

We consider a network with n single-server nodes and customers of a single 
class. The network topology is described by an oriented acyclic graph with 
the set of vertices which represent the nodes of the network, and the set 
of edges which determine the transition routes of customers. It is assumed 
that there are vertices in the graph which have no either incoming or out- 
going edges. Each vertex with no predecessors is assumed to represent an 
infinite external arrival stream of customers; provided that a vertex has no 
successors, it is considered as an output node intended to release customers 
from the network. 

Each node of the network includes a server and infinite buffer which 
together present a single-server queue operating under the first-come, first- 
served queueing discipline. It is assumed that at the initial time, all the 
servers are free of customers, the buffers in the nodes with no predecessors 
have infinite number of customers, whereas the buffers in the other nodes 
are empty. 

In addition to the usual service procedure, some special join and fork 
operations [1] may be performed in a node respectively before and after 
service of a customer. The join operation is actually thought to cause each 
customer which comes into a node not to enter the buffer at the server but 
to wait until at least one customer from every preceding node arrives. As 
soon as these customers arrive, they, taken one from each preceding node, 
are united to be treated as being one customer which then enters the buffer 
to become a new member of the queue. 
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The fork operation at a node is initiated every time the service of a 
customer is completed; it consists in giving rise to several new customers 
one for each succeeding nodes. These customers simultaneously depart the 
node, each being passed to separate node related to the first one. We assume 
that the execution of fork-join operations when appropriate customers are 
available, as well as the transition of customers within and between nodes 
require no time. 

An example of an acyclic fork-join network with n = 5 is shown in Fig. [TJ 
Note that open tandem queueing systems (see Fig. [2]) can be considered as 
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Figure 1: An acyclic fork-join network. 

trivial fork-join networks in which no fork and join operations are actually 
performed. 

1 n 

□O — -10 — - 

Figure 2: Open tandem queues. 

For the queue at node i, we denote the kth departure epoch by Xi{k) , 
and the service time of the kth customer by Tj^ . We assume that Tj^ > 
are given parameters for all i = l,...,n, and k = 1,2,..., while Xi{k) 
are considered as unknown state variables. With the condition that the 
network starts operating at time zero, it is convenient to set Xi{0) = for 
all i = 1, . . . ,n. 

In order to describe the network dynamics, we apply the (max, +)- 
algebra representation derived in [3 [8] . For the network model under study, 
the representation takes the form of the state equation 

x{k) = A{k)(^ x{k-l), (1) 

with x{k) = {xi{k), . . . , Xn{k))'^ and 

A{k) = iEeTk0G^)^P0Tk, (2) 
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where Tk = diag(Tifc, . . . , r^fc) , the matrix G is the standard adjacency 
matrix of the network graph, and p is the length of the longest path in the 
graph. 

We consider the evolution of the system as a sequence of service cycles: 
the 1st cycle starts at the initial time, and it is terminated as soon as all the 
servers in the network complete their 1st service, the 2nd cycle is terminated 
as soon as the servers complete their 2nd service, and so on. Clearly, the 
completion time of the kth cycle can be represented as 



ma.xxi(k) = \\x( 

i 

With the condition a; (0) = , we have from ([1]) 

\\x{k)\\^ = \\A{k)0---0A{l)\\^. 

The next lemma provides simple lower and upper bounds for the norm 
of the matrix 

Ak = A{k)^---^A{1). 
Lemma 5. For all k = 1,2, it holds 

k 



i=l 



k / k \ 

<\\Ak\\^<Y.\\n^+p\L^ wnu 

i=l \i=l / 



Proof. To prove the left inequality note that 



for each i = 1, . . . ,k , and so Ak>Tk® ■■■ ®Ti. Proceeding to the norm, 
and considering that %, i = 1, . . . ,k, present diagonal matrices, we get 

Pfclle > \\Tk(S>---(S>Ti\\^ 

= ||ri + --- + rfc||^. 

With Proposition [1] we have 

k k 



i=l i=l 

By applying Lemma [U we finally obtain 



k / k \^ 

i=l \i=l / 

k / k \ 

1=1 \i=l ) 



□ 
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In many applications, one is normally interested in investigating the 
steady-state mean cycle time; that is, the limit of the ratio 

l\\x{k)\\^ = ^\\A,\\^ 

as k tends to oo . We will consider this problem with relation to stochastic 
networks in the next section. 



5 Stochastic Networks 

Suppose that for each node i = 1, . . . ,n, the service times Tji, rj2, • • • , form 
a sequence of i.i.d. non-negative random variables with E[rjfc] < oo and 
ID[rjfc] < oo for all A; = 1, 2, ... . With these conditions, Tk are i.i.d. random 
matrices, whereas ||7fc||^ present i.i.d. random variables with E||7fc||^ < oo 
and D \\Tk\\^ < oo for ah /c = 1,2, . . .. 

Furthermore, since the matrix A{k) depends only on Tk, the matrices 
A{1),A{2), . . . , also present i.i.d. random matrices. It is easy to verify using 
([2]) that < E ||A(A;)||^ < oo for all /c = 1, 2, . . . . 

In the analysis of the mean cycle time of the system, one first has to 
convince himself that the limit 

lim J Pfcll = 7 

exists. As a standard tool to verify the existence of the above limit, the next 
Subadditive Ergodic Theorem proposed in [11] is normally applied. One can 
find examples of the implementation of the theorem in the (max, +) -algebra 
framework in |12^ [21 [3] . 

Theorem 6. Let {S,ik\ l,k = 1,2, . . . ; I < k} be a family of random variables 
which satisfy the following properties: 

Subadditivity: ^ik < Cim + (,mk for all I < m < k ; 

Stationarity: the joint distributions are the same for both families {£,i^ik+i\ I < 
k} and {(,ik\ I < k} ; 

Boundedness: for all k = 1,2, ... , there exists E[^o/c] ; c'^'^ E[^oA:] ^ —ck 
for some finite number c. 

Then there exists a constant 7, such that it holds 

1. lim (,0k /k = 7 with probability 1, 

k—^oo 

2. lim E[eofc]A = 7- 

In order to apply Theorem [6] to stochastic system ([T|) with transition 
matrix ([2]), one can define the family of random variables {S,ik\ I < k} with 

6fc = P(fc)$D---®A(0|L. 
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Since A{i) , i = 1,2,..., present i.i.d. random matrices, the family 
{^ik}i<k satisfies the stationarity condition of Theorem[6l Furthermore, the 
multiplicative property of the norm endows the family with subadditivity. 
The boundedness condition can be readily verified using properties of the 
norm together with the condition that < E[rjfc] < oo for all i = 1, . . . ,n, 
and A; = 1, 2, ... . 

Now we are in a position to present our main result which offers bounds 
on the mean cycle time. 

Theorem 7. In the stochastic dynamical system (OP the mean cycle time 7 
satisfies the double inequality 



|E[ri]|| <7<E||ri| 



(3) 



Proof. Since Theorem [6] hods true, we may represent the mean cycle time 
as ^ 

7 = lim -E \\Ak\\ . 

Let us first prove the left inequality in Q . From Lemmas [5] and IH we 
have 



^4- 



i=l 



> 



1 



i=l 



mTi] 



independently of k . 

With the upper bound offered by Lemma [5l we get 



SEIlrill. + fE 



,i=l 



From Lemma [31 the second term on the right-hand side may be replaced by 
that of the form 



?(E|iriiL + 



k-l 
y/2k - 1 



DllTil 



which tends to as — )• 00. 



□ 



6 Discussion and Examples 

Now we discuss the behaviour of the bounds ([3]) under various assumptions 
concerning the service times in the network. First note that the derivation 
of the bounds does not require the A;th service times Tj^ to be independent 
for all z = 1, . . . , n. As it is easy to see, if Tj^ = for all i, we have 
= E ||71||^, and so the lower and upper bound coincide. 
To show how the bounds vary with strengthening the dependency, we 
consider the network with n = 5 nodes, depicted in Fig. [TJ Let th = 
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Yl^=i ^ij^j^ ' where ^ji , j = 1, . . . , 5, are i.i.d. random variables with the 
exponential distribution of mean 1 , and 

_ J a, if i = i, 

where o is a number such that 1 < a < 1/5. 

It is easy to see that for a = 1 , one has th = , and therefore, th , 
i = 1,...,5, present independent random variables. As a decreases, the 
service times th become dependent, and with a = 1/5, we will have th = 
(6i + --- + 6i)/5 for all i = l,...,5. 

The next table presents estimates of the mean cycle time 7 obtained 
via simulation after performing 100000 service cycles, together with the 
corresponding lower and upper bounds calculated from Q. 



a 




7 


EllTille 


1 


1.0 


1.005718 


2.283333 


1/2 


1.0 


1.002080 


1.481250 


1/3 


1.0 


1.000871 


1.213889 


1/4 


1.0 


1.000279 


1.080208 


1/5 


1.0 


1.000000 


1.000000 



Table 1: Numerical results for dependent service times. 



Let us now consider the network in Fig. [T] under the assumption that the 
service times th are independent exponentially distributed random vari- 
ables. We suppose that E[rji] = 1 for all i except for one, say i = A, with 
E[t4i] essentially greater than 1. One can see that the difference between 
the upper and lower bounds will decrease as the value of E[r4i] increases. 
The next table shows how the bounds vary with different values of E[r4i] . 

Finally, let us discuss the effect of decreasing the variance D[rji] on 
the bounds on 7. Note that if th were degenerate random variables with 
zero variance, the lower and upper bounds in ^ would coincide. One can 
therefore expect that with decreasing the variance of th , the accuracy of 
the bounds increases. 

As an illustration, consider a tandem queueing system (see Fig. [2|) with 
n = 5 nodes. Suppose that th = ^ji/r, where , i = 1, . . . ,5 , are i.i.d. 
random variables which have the Erlang distribution with the probability 
density function 



frit) 



r-ie-V(r- 1)!, ift>0, 
0, ift< 0. 
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[ ' 41 J 


llE[Tilll 

II '^L ' J-J II ® 


/ 


II '111® 


1.0 


1.0 


1.005718 


2.283333 


2.0 


2.0 


2.004857 


2.896032 


3.0 


3.0 


3.004242 


3.685531 


4.0 


4.0 


4.003627 


4.554525 


5.0 


5.0 


5.003013 


5.465368 


6.0 


6.0 


6.002398 


6.400835 


7.0 


7.0 


7.001783 


7.351985 


8.0 


8.0 


8.001168 


8.313731 


9.0 


9.0 


9.000553 


9.282968 


10.0 


10.0 


10.000008 


10.257692 



Table 2: Numerical results for a fork-join network. 



Clearly, E[Tji] = 1 and D[Tii] = 1/r. Related numerical results including 
estimates 7 evaluated by simulating 100000 cycles, and the bounds on 7, 
are shown below. 



r 




7 


EllTilU 


1 


1.0 


1.042476 


2.928968 


2 


1.0 


1.026260 


2.311479 


3 


1.0 


1.019503 


2.045538 


4 


1.0 


1.015637 


1.890824 


5 


1.0 


1.013110 


1.787242 


6 


1.0 


1.010864 


1.711943 


7 


1.0 


1.009920 


1.654154 


8 


1.0 


1.008409 


1.608064 


9 


1.0 


1.007726 


1.570232 


10 


1.0 


1.006657 


1.538479 



Table 3: Numerical results for tandem queues. 
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